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Abstract 

This paper investigates the visual servoing problem for robotic systems with uncertain kinematic, 
dynamic, and camera parameters. We first present the passivity properties associated with the overall 
kinematics of the system, and then propose two passivity-based adaptive control schemes to resolve 
the visual tracking problem. One scheme employs the adaptive inverse-Jacobian-like feedback, and the 
other employs the adaptive transpose Jacobian feedback. With the Lyapunov analysis approach, it is 
shown that under either of the proposed control schemes, the image-space tracking errors converge to 
zero without relying on the assumption of the invertibility of the estimated depth. Numerical simulations 
are performed to show the tracking performance of the proposed adaptive controllers. 

Index Terms 

Visual servoing, passivity, uncertain depth, adaptive control, robotic systems. 

I. Introduction 

The interests in visual servoing for robots have lasted for many years (see, e.g., [[II, [|2l, [|3l, 
Il4l , [|5l , Q, (Si, S, IfTOl '). The visual servoing sehemes ean roughly be elassified into 
two eategories (see, e.g., [| 3 ): position-based seheme and image-based seheme. The familiar 
advantage of the image-based servoing seheme may be that the possible errors in eamera 
modeling and calibration are avoided, and that the reduction of the error in the image space 
implies that of the error in the physical task space (or Cartesian space). However, the direct 
use of image features in feedback control complicates the kinematics of the robotic system, and 
furthermore parametric uncertainty often arises (see, e.g., iTTl). 
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For handling the nonlinearity and parametrie uneertainty of the models of the visually servoed 
robotie systems, many model-based adaptive eontrol sehemes are proposed, e.g., ifTTI . ifT^ . ITTI , 

m, m, m, eoi, m, m, im, m, m- The work in bhii, m, m, d, m studies 

the visual tracking problem under the assumption that the depth is constant, in which case, 
the overall Jacobian matrix that describes the relation between the joint-space velocity and the 
image-space velocity is linearly parameterized (see, e.g., IfTTI . 01). The results that explicitly 
take into consideration the time-varying depth information of the camera appear in 0, IfTTI . 
ifTSl . ifTOl . ifT^ . IfTTI . lfT9l . and as is demonstrated in, e.g., 0, IfTTI . ifTOl . the overall Jacobian 
matrix in this case cannot be expressed as the linearity-in-parameters form since the uncertain 
depth acts as the denominator in the overall Jacobian matrix. The adaptive schemes in 0, 
[fT0|, by adaptation to the system uncertainty, ensure that the image-space position is regulated 
to the desired one asymptotically. The adaptive schemes in IfTTI . ifTSl . ifT^ . IfTTI . IfTTI realize 
image-space trajectory tracking regardless of the system uncertainty (it is noted that the work 
in ifT^ confines to the case of the target object with the specific spherical geometry so as to 
exploit certain invariant quantities, limiting its applications). The tracking control schemes in the 
existing work (e.g., IfTTI . ifTSl . IfTTI . IfTTI ). however, rely on the assumption of invertibility of the 
estimated depth (or the use of parameter projection to guarantee this) to ensure the tracking error 
convergence, due in part to the inadequate exploitation of the (potentially beneficial) structural 
property of the overall kinematics. 

In this paper, we start from formulating a new form of passivity associated with the overall 
kinematics of the visually servoed robotic system, based on which, we present two adaptive con¬ 
trollers for 3-dimensional visual tracking that neither relies on the assumption of the invertibility 
of the estimated depth nor the use of parameter projection algorithm to ensure its invertibility, in 
contrast to ftn, ftn, ftia. The avoidance of this assumption or parameter projection is important 
in that no a priori knowledge of the depth information (used for calculating the parameter region) 
is required and in addition, we do not need to concern where the estimated depth parameter finally 
stays. Among the two controllers, one employs the adaptive inverse-Jacobian-like feedback and 
the other employs the adaptive transpose Jacobian feedback. Our work extends the case of the 
constant depth considered in ifTOl (adaptive inverse Jacobian control) and IfTTI (adaptive transpose 
Jacobian control) to that of the time-varying depth, by exploiting the depth-related passivity of 
the overall kinematics and incorporating adaptation to the uncertain depth. We also show that one 
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reduced version of the adaptive inverse-Jacobian-like controller (referred to here as a separation 
approach due to its separation property, which is in contrast to the dynamic scheme in ifT^ 
that relies on a target object with the specific spherical geometry, persistent excitation condition, 
and an additional Cartesian-space sensor) is a qualified adaptive kinematic scheme that fits well 
for robots having an unmodifiable joint servoing controller yet admitting the the design of the 
joint velocity command (e.g., most industrial robots)—see Remark 2, which is in contrast to 
the existing kinematic schemes (e.g., Q, [l2ll) that lack adequation consideration of the robot 
dynamics. While the adaptive transpose Jacobian controller can be considered as a special case 
of |[T9l . the depth-related passivity and the adaptive inverse-Jacobian-like controller with the 
separation property constitute the contribution of our result with respect to |[T9ll . 

In summary, the major contribution of this work is that the passivity properties associated with 
the overall kinematics are explicitly presented, and that two adaptive controllers are proposed and 
shown to be convergent without the need of the assumption that the estimated depth is invertible; 
in addition, the separation property of the adaptive inverse-Jacobian-like controller yields an 
adaptive kinematic controller applicable to most industrial robots. It may be worth remarking 
that for most image-space tracking tasks (i.e., the desired image-space velocity is not identically 
zero at the final state), the invertibility of the estimated depth (at the final state) is required and 
can be ensured by the proposed controllers, but most existing results cannot ensure this and 
the common practice is to rely on assumption or use a relatively complex projection algorithm 
(requiring certain a priori information of the depth and the determination of an appropriate 
parameter region). A preliminary version of the paper was presented in ll22ll where the passivity 
of the overall kinematics and adaptive transpose Jacobian control were presented, and here we 
expand this version to additionally cover the adaptive inverse-Jacobian-like control. 

II. Kinematics and Dynamics 

In this paper, we consider a visually servoed robotic system that consists of an n-DOF 
(degree-of-freedom) manipulator and a standard fixed pinhole camera (see, e.g., [l2^ f. where 
the manipulator end-effector motion is mapped to the image space by the camera. For the 
convenience of the theoretical formulation, the number of the feature points that are under 
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consideration is determined as on 


J1 


A. Kinematics 


Let X E and r G B?, respeetively, denote the position of the projeetion of the feature point 
on the image plane and the position of the feature point with respeet to the base frame of the 
manipulator. The mapping from r to a: ean be written as m, m 


X 

1 

r 


- , 


1 

z{q) 

1 


( 1 ) 


where B = [D, b] G B^^'^ (with D G B^^^ and b G B^) is the perspeetive projeetion matrix, 
q E B^ denotes the joint position of the manipulator, and z{q) = + 63 E B with 63 being 

the third element of b and dj being the third row of D denotes the depth of the feature point 
with respeet to the eamera frame. The relationship between the image-spaee veloeity x and the 
feature-point veloeity f ean be written as |I71 


X = —^ (D — xd^) r (2) 

z{q) V 3 ; 

where D E B^^^ is eomposed of the first two rows of D, and N{x) = D — xdj E B^^^ is the 
depth-independent interaetion matrix defined by Q. Obviously, the time derivative of the depth 
ean be written as z{q) = djr |I71. Furthermore, it is assumed that the depth z{q) is uniformly 
positive during the motion of the manipulator. 

Let tq e B^ denote the position of a reference point on the end-effeetor with respeet to the 
manipulator base frame, fo its translational veloeity, and ujq E B^ the angular veloeity of the 
end-effeetor expressed in the manipulator base frame. The veloeities f 0 and ojq relate to the joint 
veloeity q by ^2M . iflSll 




Jr{q)q 


(3) 


*The consideration of one feature point here is for the sake of convenience of theoretical formulation, and the extension to 
the case of multiple feature points with different depths can be directly performed in a way similar to GD. For instance, in 
the case of three feature points, we can stack the image-space positions of the three feature points xi € B?, X2 € B?, and 
xz € as a single vector x = [xf, X2 , x'z]'^ and the image Jacobian matrices associated with these feature points as a single 
matrix. The ensuing procedure would then be straightforward. It may be worth noting that in this case, the depths are indirectly 
controlled by controlling sufficient number of feature points. 
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where Jr{q) € denotes the manipulator Jacobian matrix. 

The relationship between the feature-point velocity f and the joint velocity q can be written 
as lO (see also [|3, [|24l, ll^ i 


f = 



Jr{q)q 


(4) 


where Is is the 3 x 3 identity matrix, c = [ci, C 2 , 03 ]^ e denotes the position of the feature point 
with respect to the reference point on the manipulator end-effector expressed in the manipulator 
base frame, and the skew-symmetric form S'(c) is defined as 


S{c) 


0 

-C3 

C2 

C3 

0 

-Cl 

-C2 

Cl 

0 


Combining (O and dH) yields the following overall kinematic equation 0, ifT^ 


X =-^N{x)JfJr{q)q (5) 

J{q,x) 

where J(g, x) is a Jacobian matrix. The structural property of @ allows us to decompose J(g, x) 
as 


J{q,x) = DJfJriq) -xdlJfJr{q) ( 6 ) 

Jtiq) Mq) 

where J^{q) is a Jacobian matrix that maps the joint velocity g to a plane which is parallel to 
the image plane (i.e., perpendicular to the depth direction), and Jz{q) is a Jacobian matrix that 
describes the relation between the changing rate of the depth z{q) and q (see, e.g., 0 ), i.e.. 


z{q) = Jz{q)q- (V) 

We note that whether the depth z{q) is time-varying or not, the Jacobian matrix J^{q) is contained 
in J(g, x). For this, as in lfT9ll . we refer to J^{q) as the depth-rate-independent Jacobian matrix. 
The overall kinematics ® has the following property. 

Property 1: For an arbitrary vector (p E R^, the two quantities z{q)(p and z{q)(p depend linearly 
on a constant depth parameter vector E 0, IfTOl . i.e.. 


( 8 ) 

(9) 
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which also directly yields 

(l)Jz{q)q = z{q)(j) = Y^{q,q,(j))a^ (10) 

where Yz{q.,(t)) G _R 2 xmi Yz{q,q,(j)) G regressor matriees. In addition, J{q,x)q 

ean be linearly parameterized ifTOll . whieh thus leads to 

J^iq)^ = yz^iq,0ai ( 11 ) 

where G is the unknown depth-rate-independent parameter veetor, G -R” is a veetor, 
and Y^{q,^) G is the depth-rate-independent kinematie regressor matrix. 

B. Dynamics 

The dynamies of the n-DOF manipulator ean be written as If2^ . [|^ 

M{q)q + C{q,q)q +9{q) =r ( 12 ) 

where M(g) G is the inertia matrix, C(g, q) G is the Coriolis and eentrifugal matrix, 
g{q) G i?" is the gravitational torque, and r G i?" is the joint eontrol torque. In this paper, 
we assume that the number of the DOFs of the manipulator is not less than two, i.e., n > 2. 
Three familiar properties assoeiated with the dynamie model (fT^ that shall be useful for the 
subsequent eontroller design and stability analysis are listed as follows (see, e.g., If26ll . Il25ll l. 
Property 2: The inertia matrix M{q) is symmetrie and uniformly positive definite. 

Property 3: The Coriolis and eentrifugal matrix C{q, q) ean be appropriately ehosen sueh that 
M{q) —2C{q,q) is skew-symmetrie. 

Property 4: The dynamie model (O depends linearly on a eonstant dynamie parameter veetor 
OdE BP, thus yielding 

M{q)t + C{q, g)C + g{q) = Yd{q, q, (, C)ad (13) 

where Yd{q, q, C, C) ^ is the regressor matrix, C G i?” is a differentiable veetor, and C is 

the time derivative of C- 
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III. Adaptive Control 

In this section, we aim to design adaptive controllers for the visually servoed robotic system 
by formulating and exploiting the passivity of the overall kinematics. The control objective is 
to ensure the converge of the image-space tracking errors, i.e., x — Xd ^ 0 and x — —> 0 as 
f —)• cxo, where Xd G denotes the desired image-space position and it is assumed that Xd, Xd, 
and Xd are all bounded. 


A. Passivity Associated With the Overall Kinematics 

Combining dS]) and db]), we can rewrite the overall kinematics dSl) as 


z{q)x + -z{q)x = 




(14) 


where m is a virtual or intermediate control input. 

Proposition 1: The system (fT4l) is passive with respect to the input-output pair {u,x). 

Proof: Consider the following function (which is actually one part of the Lyapunov function 
in 0) 

7 .( /t') 

(15) 


T. T 

Vs = -Z-X X. 


Differentiating Vs with respect to time along the trajectories of (fT4l) yields 

Vs = x^u 


(16) 


which can be rewritten as 

x^{r)u{r)dr = Vs(t) - 14(0) > -14(0). (17) 

This implies that the system (fT4l) is passive with respect to the input-output pair {u, x) in the 
sense of [|27]| . ■ 

According to the standard passivity-based design methodology [l27ll . a simple output feedback 
for u can result in the convergence of the output x to the origin (the case of nonzero equilibrium 
shall be similar). The regulation algorithm of 0 can be considered as a combined application of 
the passivity of the overall kinematics here and the standard passivity of the manipulator dynamics 
(see, e.g., If25]l ). The passivity concerning the overall kinematics has also been examined in 0, 
yet the storage function in 0 is independent of the depth while the storage function considered 
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here is explicitly related to the depth. The main benefit of introducing this depth-related passivity, 
as is shown later, is the avoidance of the restrictive assumption of the invertibility of the estimated 
depth without relying on parameter projection. 

The control above, however, is not enough for realizing the objective of image-space tracking, 
in which case, it is expected to drive the tracking error Ax = x — Xd to the origin. To this end, 
we would like to apply the feedback passivation strategy [l28l . i.e., let the control u be given by 

u = u + z{q)xd + ^z{q)xd (18) 

feedback passivation 

where u becomes the new virtual control input. Substituting (fTSl) into (fT4l) gives 

z{q)Ax + -z{q)Ax = it. (19) 


Proposition 2: The system (fT9l) is passive with respect to the input-output pair {u,Ax). 
The proof of Proposition 2 shall be similar to that of Proposition 1. 

Using (|7]), we can rewrite (fTSl) as 


u = -z{q)xd + J^{q) - 


( 20 ) 


,7* 

Obviously, if the Jacobian matrix J* has full row rank, the virtual control it can be realized by 
the joint velocity q. 


B. Adaptive Inverse-Jacobian-like Control 

Let us now start the adaptive controller design based on the passivity enjoyed by the overall 
kinematic equation. 

Due to the passivity of the input-output pair (fi, Ax), the standard passivity-based design liTTlI 
suggests that the virtual control u = —KAx with K being a symmetric positive definite matrix 
would be qualified for realizing the image-space tracking, yet, not necessarily give guaranteed 
performance due to the variation of the depth z{q). To accommodate the varying and uncertain 
depth, we propose the following virtual control 

it = —az{q)Ax (21) 

where a > 0 is a design constant and z{q) is the estimate of z{q) which is obtained by replacing 
Oz in z{q) with its estimate a^. The use of the virtual control (|2T]) is inspired by the performance 
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guaranteed adaptive eontrol for robot manipulators in Il29l See. 3.2]. However, it should be 
emphasized that the virtual eontrol (|2TI) is not the aetual eontrol sinee it does not take into 
aeeount the dynamie effeet of the manipulator. 

Keeping (|2TI) in mind and based on (l20l) . we define a joint referenee veloeity using the 
estimated Jaeobian matrix as 

qr = J*^z{q)xr ( 22 ) 

where J* is the estimate of J* whieh is obtained by replaeing af and in J* with their 
estimates and clz, respeetively, J*^ = ^ is the standard generalized inverse of 

J* (see, e.g., If30l l. and Xr = Xd — aAx. Differentiating (l22l) with respeet to time yields the joint 
referenee aeeeleration 


qr =J* 


z{q)Xr + z{q)Xr — j*qr 


+ (4 - J*^J*)J*^J*^^q; 


(23) 


where the standard result eoneerning the time derivative of is used and In is the n x n 
identity matrix. 

Let us now define a sliding veetor as 


s = q-qr 


(24) 


whose derivative with respeet to time ean be written as 


s = q- qr- (25) 

Premultiplying both sides of (l24l) by J* and using ([5]), (|7|), (l22l) . and Property 1 yields 

J*s =z{q)x + ^z{q)Ax — J*qr 

+ Yj-{q, qr)Aaj - ^Yziq, qr, x + Xd)Aaz 
=z{q) {Ax + a Ax) + ]^z{q)Ax + Y^{q, qr)Aa^ 

- [Yz{q,Xr) + ]^z{q,qr,x + Xd)]Aaz (26) 

yi{qAr,X+Xi,Xr) 
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where Aa^ = and Aa^ = — a^. Equation (|2^ ean be rewritten as 

z{q)Ax + -z{q)Ax = — az{q)Ax — Yj-{q, Aa^ 

+ Y*{q, (jr, X + Xd, Xr)Aa 2 + J*s. 


(27) 


Now we propose the following eontrol law 


Ks + Yd{q, q, qr, qr)ad 


(28) 


where is the estimate of and is a symmetrie positive definite matrix. The adaptation 
laws for updating d^, d^, and d^ are given as 



(29) 


(30) 


(31) 


where T^, r 2 , and are symmetrie positive definite matriees. 

Remark 1: The feedback term —Ks in (l28l) can be interpreted as inverse-Jacobian-like control 
based on (l27l) . and it appears that both the image-space tracking errors and parameter esti¬ 
mation errors Aa^ and Aa^ are included. The parameter adaptation laws (l30l) and (ISTl) rely 
on the two regressor matrices that use the joint reference velocity and thus are actually 
adaptive in the sense that they are updated in accordance with the updating of the parameter 
estimates. The avoidance of the assumption of invertibility of the estimated depth is reflected in 
(1271) . Asymptotically, the final closed kinematic loop behaves like the one with a feedforward 
z{q)xd and a feedback —az{q)Ax since the term related to the parameter estimation errors 
= —y/(g, qr)Aa^ + Y*{q, g^, x + Xd, Xr)Aaz converges to zero asymptotically (which can be 
shown by the consequence of Theorem 1 below). From the result that $ —> 0 as f —)■ oo, we 
have that 



(32) 


as f ^ oo. Then, it can be shown by contradiction that z{q)xd 0 so long as z{q)xd ^ 0 or 
7 ^ 0 as t —)■ oo. This can be interpreted as “if Xd does not converge to zero, then the estimated 
depth z{q) would converge to an invertible quantity”. 
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Substituting the control law (l28l) into (fT^ gives 

M{q)s + C(g, q)s = -Ks + Yd{q, q, qr, qr)^ad (33) 

where Aa^ = ad — ad is the dynamic parameter estimation error. 

The closed-loop behavior of the visually servoed robotic system can then be described by 
(127]), (133]), dH, (130]), and (HB- 

We are presently ready to formulate the following theorem. 

Theorem 1: For the visually servoed robotic system given by dB, dl]), and (HB, the control 
law (l2^ and the parameter adaptation laws (l29]) . (l30]) . and (l3T]) ensure the convergence of the 
image-space tracking errors, i.e.. Ax —)■ 0 and Ax —)■ 0 as f —)■ oo. 

Proof: Following OTII . [133 . we take into account the Lyapunov-like function candidate Vi = 
(l/2)s'^M(q)s + (l/2)AaJr^^Aad, and differentiating Vi with respect to time along the tra¬ 
jectories of (l3^ and (l29]) and exploiting Property 3, we have Vi = —s^Ks < 0, which then 
implies that s e £2 H and G Coo- 

The boundedness of J* implies that J*s G £ 2 - In addition, z{q) is uniformly positive by as¬ 
sumption. Then, there must exist a positive constant Im such that Jl^{l/z{q{r)))s'^{r)J*'^{r)J*{r)s{r)dr < 
(m, Vf > 0. Based on the passivity of the system kinematics, consider a nonnegative function 

-.T-r-l 


V 2 =^z(q)Ax^Ax + ^Aafr, ^Aa, + ^Aaj^rj ^Aa^ 


1 

2a 


Im — 


z{q{r)) 


{r)J*^ {r)J*{r)s{r)dr 


(34) 


“V* 

n* 


where the term If* follows the result in [|27l p. 118]. Differentiating V 2 with respect to time 
along the trajectories of (l27]) . (l30]) . and (l3T]) gives 

1 


V 2 = —az(q)Ax^ Ax + Ax^ J*s — 


2az{q) 

Combining the following result derived from the standard inequality 

az{q) . T’ . 1 


s^r^rs. 


Ax^J*s < 


-Ax^ Ax -f 


2az{q) 


s^r^J*s 


and (l35]) yields 


1/2 < 


az{q) 


Ax^Ax < 0. 


(35) 


(36) 


(37) 


This implies that Ax G £2 H Coo, ^ Coo, and af G Coo- Then, we get the result that x G Coo, 
z{q) G Coo, and Xr G Coo- From (l22]) . we obtain that ^ £00 if J* has full row rank (which 
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ensures the existenee of the generalized inverse of J* aeeording to the standard matrix theory). 
Therefore, q = s + E /loo- From the overall kinematies Q, we have that x G Coo and further 
Ai: G Coo, whieh then implies that Ax is uniformly eontinuous. From the properties of square- 
integrable and uniformly eontinuous funetions [1^ p. 232], we have that Ax ^ 0 as t ^ oo. 
From (l30l) and (l3TI) . we obtain that az G Coo and df G Coo, giving rise to the boundedness of 
z{q) and J*. Then, we obtain from (1231) that gV G Coo- Based on (|3^ and the faet that M{q) 
is uniformly positive definite (by Property 2), we have that s G Coo- This immediately implies 
that q G Coo- From the differentiation of © with respeet to time, we have that x G Coo- Henee, 
Ax G Coo, whieh means that Ax is uniformly eontinuous. From Barbalat’s Lemma ll2^ . we 
obtain that Ax —> 0 as f —)■ cxo. ■ 

C. Adaptive Transpose Jacobian Control 

The adaptive transpose Jaeobian eontrol is given as 

r = - J*^KiJ*s + Yd{q, q, qr, qr)dd (38) 

dd = -TdYj{q,q,qr,qr)s (39) 

dz = - TzYf{q, g, X + Xd, Xr) Ax (40) 

(41) 

where Ki is a symmetrie positive definite matrix. This eontroller turns out to be aetually identieal 
to a redueed version of the one in ifT^ (i.e., by assuming that the image-spaee veloeity ean be 
preeisely obtained). Detailed analysis ean be found in our preliminary work [l22ll . The differenee 
between the adaptive transpose Jaeobian eontrol seheme and the adaptive inverse-Jaeobian-like 
eontrol seheme not only lies in the feedbaek part but in the depth and depth-rate-independent 
kinematie parameter adaptation laws. In faet, the regressor matriees used in (l40l) and (IdTl) are 
not adaptive in eontrast with the adaptive ones used in the adaptive inverse-Jaeobian-like eontrol 
seheme. The expense that we have to pay due to the use of non-adaptive regressor matriees is a 
relatively strong feedbaek, i.e., the adaptive transpose Jaeobian feedbaek —J*^KiJ*s in (l3^ . 

Remark 2: 

1) In most industrial robotie applieations, the available eontrol eommand is the joint veloeity 
(position) rather than the joint torque. It seems interesting that one redueed version of the 
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proposed adaptive inverse-Jaeobian-like eontrol does fit this seenario well, i.e., the adaptive 

kinematie eontrol seheme given by [from (l22l) . (l30l) . and (l3T]) 1 

' 

Qr = J*^z{q)Xr 

< qr, X + Xd, Xr) Ax (42) 

where qr aets as the joint veloeity eommand. This kinematie eontrol seheme yields a 
elosed-loop system given by (ITTl) and the two adaptation laws in (l42l) . Under the eommon 
assumption that the joint servoing module guarantees that the joint veloeity tends suffi- 
eiently fast to the joint veloeity eommand [i.e., the joint referenee veloeity qr given in 
(l42l) 1 in the sense that s is square-integrable and bounded, the term J*s in (l27l) is square- 
integrable and bounded. Then, taking the same nonnegative funetion as (IMl) and following 
similar analysis as in the proof of Theorem 1 would immediately yield the eonelusion that 
the image-spaee traeking errors eonverge to zero. 

2) The adaptive transpose Jaeobian eontrol, unfortunately, does not enjoy the above properties, 
whieh is mainly due to the transpose Jaeobian feedbaek in (1^ and the parameter adaptation 
laws (ITO and (1411) . 


IV. Simulation Results 

Consider a visually servoed robotie system eomposed of a standard three-DOF manipulator 
and a fixed eamera (as shown in Fig. 1). The foeal length of the eamera is set as / = 0.16 m 
and the sealing faetor of the eamera /3 = 1200.0. Assume that the three axes of the eamera 
frame whieh are denoted by Xq, Yq and Zc, respeetively are aligned with the axes Yq, Zq, and 
Xq of the manipulator base frame, respeetively, and the origins of the two frames has an offset 
along the axis Zc, i.e., dc = 6.0 m. The lengths of the three links of the manipulator are set as 
li = 2.1 m, /2 = 2.1 m, and 1^ = 1.9 m. The sampling period in the simulation is ehosen to be 
5 ms. 

We first perform the simulation of the elosed-loop system under the adaptive inverse-Jaeobian- 
like eontrol with the eontroller parameters being ehosen as K = 4O.O/3, a = 10.0, F^ = 
200.0/3, Tz = O.OO8/3, F^ = 260.0/2. The initial values of the kinematie and eamera pa¬ 
rameter estimates are ehosen as (2(0) = (3(0) = 3.2 m, dc{9) = 3.2 m, /(O) = 0.09 m, and 
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Camera 




Fig. 1. Three-DOF manipulator with a fixed camera (from OH) 


/3(0) = 2000.0. The initial value of the dynamie parameter estimate is ehosen as 0^(0) = 
[0g,30,0]^ while the aetual value of the dynamie parameter is = [8.2688,2.9925,1.3538, 
0.2578,10.6250,1.8050,46.3050,13.9650]C The desired trajeetory in the image spaee is given 
53 + 21 cos(7rt/3) 

as Xd = ■ The simulation results are plotted in Fig. 2, Fig. 3, and Fig. 4. 

79 + 21 sin(7rf/3) 

As ean be seen from Fig. 2, the image-space position tracking errors indeed converge to zero 
asymptotically. Fig. 3 illustrates the responses of the actual and estimated depths during the 
motion of the manipulator. It appears that the estimated depth has the tendency of tracking the 
actual depth, which is due to the depth parameter adaptation. Fig. 4 gives the response of the 
control torques. 

We then perform the simulation of the closed-loop system under the adaptive transpose 
Jacobian control where the gain Ki is chosen as Ki = O.OOI5/2, and the other controller 
parameters, the initial parameter estimates, and the desired image-space trajectory are chosen to 
be the same as above. The simulation results are shown in Fig. 5, Fig. 6, and Fig. 7. 

The comparison between Fig. 2 and Fig. 5 and that between Fig. 3 and Fig. 6 show that the 
inverse-Jacobian-like control tends to yield better/smoother dynamic responses of the tracking 
errors and the estimated/actual depths than the transpose Jacobian control, yet from an overall 
perspective, their performance is comparable. 
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Fig. 2. Image-space position tracking errors 



Fig. 3. Actual and estimated depths 



Fig. 4. Control torques 
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Fig. 5. Image-space position tracking errors 



Fig. 6. Actual and estimated depths 



Fig. 7. Control torques 
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V. Conclusion 

In this paper, we have examined the traeking eontrol problem for visually servoed robotie 
systems with uneertain kinematie, dynamie, and eamera models. We start by formulating the 
passivity of the overall system kinematies, and then present two passivity-based adaptive eontrol 
sehemes. It is shown by the Lyapunov analysis approaeh that the image-spaee trajeetory traeking 
errors eonverge to zero. It is also shown that one redueed version of the adaptive inverse-Jaeobian- 
like eontroller is well suited to robots having an unmodifiable joint servoing eontroller yet 
admitting the design of the joint veloeity eommand. Simulations using a three-DOF manipulator 
with a fixed eamera are eondueted to show the eonvergent property of the proposed adaptive 
eontrollers. 
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